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Partitioning Cache Metadata State 



Field 

The invention relates to operating systems, and more particularly, to cache 
memory devices in operating systems. 

General Description 

The use of a cache in a computer reduces memory access time and 
increases the overall speed of a device. Typically, a cache is an area of memory 
which serves as a temporary storage area for a device and has a shorter access 
time than the device it is caching. Data frequently accessed by the processor 
remain in the cache after an initial access and subsequent accesses to the same 
data may be made to the cache. 

Two types of caching are commonly used, memory caching and disk 
caching. A memory cache, sometimes known as cache store, is typically a high- 
speed memory device such as a static random access memory (SRAM). Memory 
caching is effective because most programs access the same data or instructions 
repeatedly. 

Disk caching works under the same principle as memory caching but uses a 
conventional memory device such as a dynamic random access memory (DRAM). 
The most recently accessed data from the disk is stored in the disk cache. When a 
program needs to access the data from the disk, the disk cache is first checked to 
see if the data is in the disk cache. Disk caching can significantly improve the 
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performance of applications because accessing a byte of data in RAM can be 
thousands of times faster than accessing a byte on a disk. 

Both the SRAM and DRAM are volatile. Therefore, in systems using a 
volatile memory as the cache memory, data stored in the cache memory would be 
lost when the power is shut off to the system. Accordingly, some existing devices 
may have a battery backup to 'emulate 1 the behavior of a non-volatile cache by not 
letting the device go un-powered. However, using an emulated cache increases 
the cost and reduces the reliability of the device, thereby making it unattractive to 
users. 

In other devices, data is moved fror/i the cache to a non-volatile storage 
device to preserve the cache data through a system shutdown or power failure. 
However, in order to use the data that mas been stored on the non-volatile storage 
device, the state of the cache or metadata need to be preserved. If the state is not 
preserved the system still needs to reinitialize the cache because the state of data 
currently in the cache is unknown. 

Although the initialization time is not long in smaller caches (tens of mega- 
bytes), the initialization time for a cache in the Gigabyte range can possibly last 
longer than a typical personal computer (PC) use session. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The invention will be described in detail with reference to the following 
drawings in which like reference numerals refer to like elements wherein: 

Figure 1 is an exemplary system in accordance to one embodiment of the 
invention; 

Figure 2 is an exemplary memory layout in accordance to one embodiment 
of the invention; and 

Figure 3 shows an exemplary storage method in accordance with one 
embodiment of the invention. 
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DETAILED DESCRIPTION 



In the following description, specific details are given to provide a thorough 
understanding of the invention. For example, some circuits are shown in block 
diagram in order not to obscure the present invention in unnecessary detail. 
5 However, it will be understood by those skilled in the art that the present invention 
may be practiced without such specific details. 

As disclosed herein, a "cache" refers to a temporary storage area and can 
be either a memory cache or a disk cache. The term "system boot" refers to 
initialization of a computer both when the power is first turned on, known as cold 

rn 

uglO booting, and when a computer is restarted, known as warm booting. The term 

*0 "computer readable medium" includes, but is not limited to portable or fixed storage 
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■fj devices, optical storage devices, and any other memory devices capable of storing 

^ computer instructions and/or data. The term "computer instructions" are software 
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fF f or firmware including data, codes, and programs that can be read and/or executed 
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dglS to perform certain tasks. 
□ 

! s 

Generally, a non-volatile storage media is used as a non-volatile data cache. 
In one embodiment of the invention, the cache state metadata is stored in a 
partitioned section of the non-volatile storage media. By storing this metadata in 
the non-volatile storage media, the cache state can be preserved through a power 
20 failure or normal system shutdown. 

An exemplary embodiment of a system 100 implementing the principles of 
the invention is shown in Figure 1. The system 100 includes a processor 110 
coupled to a main memory 120 by a bus 130. The main memory 110 may 
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comprise of a random-access-memory (RAM) and is coupled to a memory control 
hub 140. The memory control hub 140 is also coupled to the bus 130, to a non- 
volatile storage cache device 150 and to a mass storage device 160. The mass 
storage device 160 may be a hard disk drive, a floppy disk drive, a compact disc 
5 (CD) drive, a Flash memory (NAND and NOR types, including multiple bits per cell) 
, a ferroelectric RAM (FRAM), or a polymer FRAM (PFRAM) or any other existing or 
future memory device for mass storage of information. The memory control hub 
140 controls the operations of the main memory 120, the non-volatile storage 
cache device 150 and the mass storage device 160. Finally, a number of 
10 input/output devices 170 such as a keyboard, mouse and/or display may be 
2 coupled to the bus 130. 

jO Although the system 100 is shown as a system with a single processor, the 

invention may be implemented with multiple processors, in which additional 

processors would be coupled to the bus 130. In such case, each additional 

□ 

ml5 processor would share the non-volatile storage cache device 150 and main 
memory 120 for writing data and/or instructions to and reading data and/or 
instructions from the same. Also, the non-volatile storage cache device 150 is 
shown external to the mass storage device 160. However, the non-volatile storage 
cache device 150 can be internally implemented into any non-volatile media in a 
20 system. For example, in one embodiment, the non-volatile storage cache device 
150 can be a portion of the mass storage device 160. The invention will next be 
described below. 

Because retrieving data from the mass storage device 160 can be slow, 
caching can be achieved by storing data recently accessed from the mass storage 
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device 160 in a non-volatile storage media such as the non-volatile storage cache 
device 1 50. Next time the data is needed, it may be available in the non-volatile 
storage cache device 150, thereby avoiding a time-consuming search and fetch in 
the mass storage device 160. The non-volatile storage cache device 150 can also 
be used for writing. In particular, data can be written to the non-volatile storage 
cache device 150 at high speed and then stored until the data is written to the mass 
storage device, for example, during idle machine cycles or idle cycles in a mass 
storage subsystem. 

Figure 2 shows an exemplary layout ^f a non-volatile storage media 200 
including a first section 210 and a second abction 220. In the first section 210, the 
data with corresponding error correction cade (ECC) can respectively be stored in 
cache lines "A," "B," "C," "D n ... "x" with corresponding block addresses 0, 1, 2, 
3...n. In the second section 220, metadata for cache lines "A," "B," "C," "D" ... "x" 
with corresponding ECC can respectively be stored in block addresses "n+1," 
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Sli5 "n+2"... "n+m." Here, the ECC is for recovering the metadata stored in a 



corresponding block address. Also, although the non-volatile storage media 200 is 
showno to have a memory line of 512 bytes, the size of the cache line may vary 
depending upon the needs of the system 100. 

Figure 3 shows an exemplary embodiment of data storage and access 
20 method 300 in accordance with the invention. Referring to Figure 3, a non-volatile 
storage media is partitioned (block 310). In one embodiment, the partitioning is 
logical. Using the non-volatile storage media as a cache memory device, the 
memory control hub 140 in Figure 1 causes cache data to be stored in a first 
partitioned section, for example, the first section 210 of Figure 2, and causes 
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metadata for the cache data to be stored in a second partitioned section, for 
example, the second section 220 (block 320). In one embodiment, as shown in 
Figure 2, the metadata is partitioned into packed metadata blocks. As a result, 
each line of the second section may contain information about several cache lines. 

The cache data and metadata are then updated when a line of cache data in 
the first section is changed (blocks 330 and 340). A line of cache data may change 
as new data is stored and/or existing lines of stored data is replaced or de-allocated 
to make room for new lines of data. Here, any caching algorithm can be used to 
update the data and metadata. In one embodiment, the cache data and metadata 
is updated atomically with respect to a system power fail. The use of an atomic 
update insures that there will be no race-condition in maintaining both the cache 
data and the metadata due to a power fail, thereby insuring the maintenance of 
data integrity. 



\^ By storing both the metadata and the data on a non-volatile media, the state 
of the cache and its respective data can be accessed upon a system boot, resulting 
in a significant reduction of the initialization time for a cache. This is particularly 
useful as the size of the cache grows, for example, to a Gigabyte range. 

Accordingly, when the state of the cache needs to be known such as when a 
system boot is detected, the partitioned section of a non-volatile storage media may 
be accessed to read metadata entries to determine the state of the cache. If the 
metadata is stored as packed metadata blocks, one line or block of the partitioned 
section of a non-volatile storage media would contain metadata information of 
several cache lines. Therefore, multiple metadata entries can be read in one 
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operation. In another embodiment, the partitioned section of a non-volatile storage 
media storing the metadata can be queried as data requests are issued from a 
host such as a processor. 

Normally, users would benefit by a quicker initiation of system operations. 
This could occur in at least three areas. Initially, when a computer is turned on or 
the user runs a new program, operations should begin as quickly as possible. 
Second, when a program error or crash occurs, the computer should be restarted 
as soon as possible. Similarly, when a variety of issues come up during the course 
of computer operation, some users may want to simply restart the computer to 
avoid dealing with and identifying the source of the problem. 

Typical cache devices are volatile and should be rebuilt on a next system 
boot. However, the storage and access method in accordance with the invention 
eliminates the need and time necessarwto rebuild the cache on a system boot. By 
storing the metadata on a partitioned section of the non-volatile storage media, the 
state of the cache can correctly be determined on a next system boot. This 
enables the full benefit of having the/cache pre-warmed or fully occupied with data, 
because the user data and prograrn code is already stored in the faster cache from 
previous user sessions. As a result, the system performance is improved on the 
next system boot/power on. / 

While the metadata can be appended onto each cache line or stored in a 
volatile system memory, partitioning the meta-data into a separate array allows for 
several cost and performance advantages. One such advantage is that the 
partitioning allows the metadata to be stored into packed metadata blocks for more 
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efficient access to metadata, as information about several cache lines in the same 
operation can be obtained as apposed to a unique request per cache line. Another 
advantage is that the standard array layout of the metadata can simplify both the 
layout and device logic design, reducing the overall cost of a memory device. 
5 Furthermore, the invention can simply and easily be implemented by using a mass 
storage device that is logically partitioned for use as a cache device through 
software/firmware programming. This also lowers cost and improves development 
time by reducing the number of unique memory device designs needed. 

Finally, although the invention has been discussed with reference to a cache 
p^IO memory device, the teachings of the invention can be applied to other memory 

m devices storing data and state data. Accordingly, the foregoing embodiments are 

m 

In merely exemplary and are not to be construed as limiting the present invention. 
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N The present teachings can be readily applied to other types of apparatuses. The 
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L description of the present invention is intended to be illustrative, and not to limit the 
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2*15 scope of the claims. Many alternatives, modifications, and variations will be 
P apparent to those skilled in the art. 
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